BEST CONSTANT AND VALUE OF EXTREMIZERS FOR A A>PLANE 

TRANSFORM INEQUALITY 



ALEXIS DROUOT 



ABSTRACT. The fc-plane transform TZk acting on test functions on M. d satisfies a dilation- 
invariant L p —> L q inequality for some exponents p, q. We will explicit some extremizers 
and the value of the best constant for any value of k and d, solving the endpoint case of a con- 
jecture from Baernstein and Loss. This extends their own result for k = 2 and Christ's result for 
k = d-\. 



1. Introduction 

Let us choose d > 2, 1 < k < d — 1 and denote by Q k the set of all fc-planes in ~§t d , 
that means affine subspaces in W 1 with dimension k. We define the fc-plane transform of a 
continuous function with compact support / : W. d — > E as 



TZ k f(U) = [ fdX u 
Jn 



where H E Qk and the measure An is the surface Lebesgue measure on II. The operator TZk 
is known as the Radon transform for k — d — 1 and as the X-ray transform for k — 1. It is 
well known since the works of Oberlin and Stein [ ], Drury [ ] and Christ [5] that TZk can be 

extended from L~ to L d+l (Qk) for a certain measure on Qk that needs to be defined. Let 
us denote by Ai k the submanifold of Q k of all A;-planes containing 0. The Lebesgue measure 
on W l induces a natural measure on Ai k : there exists a unique probability measure fi k on 
Aik invariant in the following sense: if f2 is an orthogonal map, P is a subset of M k , then 
Hk (P) = [ik (£1P). The construction of this measure can be found in [13]. This induces a 
measure on Q k , a k , defined as follows: 

(Li) a k (A)= [ Affie^.i + neAjJd/i^n), 

Jn&M k 

where A designs the Lebesgue surface measure on the d — A;-plane. (1.1) defines a measure on 
Qk invariant under translations and rotations in the following sense: if VL is an orthogonal map, 
P is a subset of Q k , and x 6 R d , then a k (P) = a k (UP + x). 



The L fe +! (R d ) to L d+1 (Q k , Ok) boundedness of TZ k leads to the inequality 

d-2) \\n k f\\ Ld+H g k , ak) < A(k,d)\\f\\ Lm ^ d) , 

for a certain constant A (k, d) chosen to be optimal. 

Some standard questions appear: 

1- What is the best constant in the above inequality? 

2- What are the extremizers for this inequality? 

3- Is any extremizing sequence relatively compact -modulo the group of symmetries? 
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4- What can we say about functions satisfying ||7?. fc /|| d+ i > c||/|| d+i? 



fc+i 



Some of the answers are already known for some values of k. In [1], Baernstein and Loss 
solved the first question for the special case k — 2, and formulated a conjecture about an ex- 
tremizer value for a larger class of LP — > L q inequalities. Christ solved their conjecture and 
answered all the above questions with the three papers [6], [7], [9], for the case k = d — 1. 

By a quite different approach, we will give in here a proof of Baernstein and Loss' conjecture 
for any value ofk, d in the inequality (1.2). Note that this concerns only the endpoint case of 
their general conjecture. The value of the extremizers provides the explicit value of the best 
constant in the inequality (1.2). 

Main result. Our main result is the following theorem: 

Theorem 1.1. (i) There exist radial, nonincreasing extremizers for (1 .2). Moreover, any 
extremizing sequence of nonincreasing, radial functions is relatively compact -modulo 
the group of dilations. 



(ii) Some extremizers for (1.2) are given by 

h(x) -- 



C 



1 + \\Lx 



2 



fe+l 
2 



where L is any invertible affne map on M d , and C is a constant, 
[iii) The best constant A (k, d) is equal to 



(1.3) 



\TZ k h\ 



d+l 



\h\\ d+l 

"fe+1 



k-d 



\S 



k\d 



l 

d+l 



\s d \ l 

where \ S l ~ l \ denotes the Lebesgue surface measure of the i — 1-sphere. 

The concept of extremizing sequence has not been defined yet. We will say that f n is an 
extremizing sequence for the inequality (1.2) if for all n, \\f n \\d+i = 1 and ||7£fc/n||d+i — > 

A(k,d). Thus the second part of (i) means that if /„ is an extremizing nonincreasing, ra- 
dial functions, then there exists a sequence of real numbers called \ n such that the sequence 

d+i 

x i — ^ \ n d+1 fn (A n x) admits a subsequence converging in i>+i. 



This introduces the main difficulty in (i). Indeed, the group of invertible, affine maps is a 
noncompact group of symmetry for (1 .2). Thus if we choose an arbitrary extremizing sequence, 
then in the most general case it will converge weakly to the null function. We have to overcome 
this difficulty. 

Our proof takes its inspiration from three different papers. To prove (i), we follow Lieb's 
approach to prove the existence of extremizers for the Hardy-Littlewood-Sobolev inequality, 
in his famous paper [12]. The major difference here is the way to prove that after suitable 
rescaling, an extremizing sequence converges weakly to a non-zero function. It is not very 
surprising that Lieb's approach for the Hardy-Littlewood-Sobolev inequality can be used to 
solve our problem; in fact, it is very similar to the /c-plane transform inequality. Part (i) of 1.1 
can be seen as a corollary of the following generalized theorem, whose assumptions are also 
satisfied by the Hardy-Littlewood-Sobolev inequality: 

Theorem 1.2. Let m be an integer, a a measure on IR + such that a ({0}) = 0. Let T be a 
linear operator satisfying all the below assumptions: 
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(i) T maps LP (M + , r m ~ l dr) to L q (IR + , a) with 1 < p < q < oo and T maps the Lorentz 
space L p ' p+5 r m ~ l dr) to the Lorentz space L q,q ~ 5 (M + , a) for some 5 > such 
that p + 5 < q — 5; 

(ii) T satisfies the rearrangement inequality ||7"/||g < \\T (f*) \\ q , where f* denotes the 

-radial- nonincreasing rearrangement of f, with respect to r m ~ l dr; 
(Hi) For any nonnegative, nonincreasing function f, Tf is also nonincreasing; 
(iv) The inequality 

(1-4) UT/||,<i4||/||p 

is invariant under the standard action of dilations. 

Then the inequality (1.4) admits nonincreasing, radial extremizers. Moreover, any extremizing 
sequence of decreasing functions is relatively compact modulo the group of dilations. 

Two assumptions are essential in this theorem. The continuity in Lorentz spaces will help us 
prove a concentration compactness lemma, reducing the difficulties generated by the dilation- 
invariance. The rearrangement inequality (ii) will generate some additional compactness. 

As already said, we can also apply this general theorem to the Hardy-Littlewood-Sobolev 
inequality. It shows that there exist extremizers. Nevertheless this will not give the value of the 
best constant, which, furthermore, has been known for a long time. But sometimes the single 
knowledge of existence of extremizers is enough to get their values and the value of the best 
constant, because extremizers satisfy a certain Euler-Lagrange equation. If the solutions of this 
equation are known, then the best constant can be computed. 

To find the best constant in the A;-plane inequality (1.2) we will use an approach introduced 
by Carlen and Loss in [4], that they call competing symmetries. We will need the existence 
of an additional symmetry S of (1.2), that does not map radial functions to radial functions. 
It could be seen as a problem but it is actually a very helpful information. The choice of this 
symmetry is the generalisation of a symmetry found by Christ in [9] in the special case of the 
Radon transform. Coming back to the process introduced by Carlen and Loss and using the 
existence theorem (i) it will lead to the value of some extremizers and then of the best constant. 

Nevertheless the approach that they followed led them to all the extremizers, using some 
additional work for the equality case in the rearrangement inequality. This does not work for 
us, and then we do not prove that the extremizers are unique modulo the invertible affine maps. 
In the last section, we explain how a theorem that states that any extremizer can be written 
/ o L for / radial and L an invertible affine map actually leads to the explicit value of all the 
extremizers. A theorem like this one has already been proved by Taryn Flock for k = 1; it 
follows that in the case of the X-ray transform, all the extremizers are given by (1.3). 

For the rest of the paper, let us note the following: 

• Let A and B be positive functions and P be some statement. We will say that P implies 
that A < B when there exists a -large- universal constant C, which depends only on 
the dimension d, such that P implies that A < CB. A > B will be the convert and 
A ~ B will be used when A < B and B < A. 

• A radial function will be considered all along the paper either as a function on M. d or as 
a function of the norm, depending on the context. 

• \E\ denotes the Lebesgue measure of a set E, except in the case of a sphere. 
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• d (0, II) denotes the euclidean distance between and II a A;-plane, that is 

d(0,n) = inf \\y\\. 

J/Gll 

• IS"^^ 1 ! denotes the Lebesgue surface measure of the euclidean sphere of R m 

• e d is the vector (0, 0, 1). 

• For x a vector on M d , we will write x = (x', Xd) with x' G and Xd G R. 

• || /Hp denotes the L p -norm of /, with respect to a contextual measure. 

• R + is the set (0, oo). 



I am indebted to Michael Christ who showed me this very interesting subject, and who 
pointed out some useful papers. I am also indebted to Jean-Marc Delort for a partial proofread- 
ing of the manuscript. 

2. Preliminaries 

In this section we introduce some -standards- notions which will be useful for what follows. 
We will talk about the theory of radial, nonincreasing rearrangement of a function and the 
theory of Lorentz spaces. Grafakos's book [11], is surely a more complete introduction. 

Radial nonincreasing rearrangement. Let us consider p a measure on M. d and E a measur- 
able subset of M. d . We denote by E* the unique closed ball centred at the origin such that 
p (E*) = p (E); now for / a measurable function from R d to [0, oo], and t > 0, let us call 

E f (t) = {xtR d ,\f(x)\>t}. 

Then we have the following proposition: 

Proposition 2.1. Let f be a measurable function from R d to M. U ±oo; there exists a unique 
function f*,from M. d to [0, oo] such that 

(2.1) E lfl (ty = E r (t). 

Moreover, f* is radial, nonincreasing -as a function of the norm. We furthermore have the 
properties: 

(z) for all measurable functions f G L p , with 1 < p < oo, ||/|| p = ||/*|| p , 
(ii) for all measurable nonnegative functions f G L p , g G L p , with 1 < p < oo, \\f — g\\ p < 

wt-9%, 

(Hi) for all measurable nonnegative functions f,g,f<g^>f*< g*, 
(iv) for all measurable nonnegative functions f, for all X > 0, Xf = (A/)*. 

Points (i) to (iv) show that the nonlinear operator / \-t f* is actually a properly contractive 
operator -see section 4. The map /* is called the symmetric rearrangement of / -with respect 
to the measure p,. 

Lorentz spaces. Let l<p<oo, l<r<oo, pa measure on a measurable space X. We 
will call L p ' r = L p ' r (X, p) the Lorentz space of order (p, r). Let us recall some notions about 
Lorentz spaces. Let / be a function from X to 1 and df be the distribution function of /, 
defined as 

df(t) = p({xex,\f(x)\>t}), 

for t > 0. Let us then define the quasi-norm on L p ' r as 

ll/ll^=(jf *) r f) ? 
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where the integral is as usual changed to a sup if r = oo: 

i. 

||/||lp.°° = swpdf (t)p t. 

t>0 

The term quasi-norm means that the quantity defined above does not satisfy the triangle in- 
equality, but satisfies instead the following: 

3C, V/, g G L p,r \ ||/ + g\\ LP ,r < C {\\f\\ LP ,r + \\g\\ LP ,r) . 

The spaces L p,r are quasi-complete for the values of p, r described above. 

The last thing that we need to know about Lorentz spaces is the useful interpolation inequal- 
ity 

(2.2) ii/ii^ <ii/iissoii/ie 

for / G L p , 1 < p < oo. Indeed, 

f°° / l \ r dt ( i \ T ~ V f°° / 1 \ P (it 

ii/iii- = J o (df(t)tt) j<Luvdf(t)t-A y o (^rw^) 7 = 11/11^-11/11?- 

3. Existence of extremizers 

We have now all the tools to prove part (?) of 1.1. To simplify the notations, let us fix k and 
d and call q — d + 1, p = 1Z = TZk, Qk = G, &k = & an d A = A(k,d). We are then 
interested in the existence of extremizers for the inequality 

(3-D \W\\ q < A\\f\\ p . 

A naive approach is of course to consider (/„) an extremizing sequence for this inequality, 
meaning ||/ n || P = 1 and ||72./ n || g — > A, and to prove that f n converges strongly. This, as 
already said, is not possible. Indeed, the inequality (3.1) enjoys a large and non-compact group 
of symmetries, the invertible affine maps. By that we mean that if / G L p and L is an invertible 
affine map then we have the identity 

\\K(foL)\\ q _ \\Kf\\ q 

\\f°L\\ P \\f\\ P ' 

For a proof, see lemma 4.9. The non-compactness of this group implies in particular that an 
arbitrary extremizing sequence has no chance to converge -even weakly- in LP to a non-zero 
function. We then need to transform an arbitrary extremizing sequence under the action of 
invertible affine maps to make it converge. This action is defined by 

(L,f)^det(L)pfoL 
and preserves the L p -norm of / and the L 9 -norm of IZf. 



Some useful facts. The /c-plane transform satisfies the rearrangement inequality 
(3-2) \\Kg\\ q <\\ll{g*)\\ q . 

Christ proved this in [5]. That way, instead of considering an arbitrary extremizing sequence, 
we can consider an extremizing sequence of radial, nonincreasing functions. It obviously 
makes the study much easier, passing from functions on M. d to nonincreasing functions on 
[0, oo). But the group of dilations is still a non-compact group of symmetries for the fc-plane 
transform inequality, even restrained to the radial, nonincreasing functions. Thus we still have 
to deal with the loss of compactness explained above, but since this loss is only due to dilations, 
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it is easier to deal with. 

In [5], Christ proved a really useful boundedness theorem for our purpose: the fc-plane trans- 
form maps the Lorentz space L ps to the Lebesgue space L q . Note that p < q and then we 
can apply the interpolation theory for Lorentz spaces -see [2] for instance. It shows that 1Z is 
actually continuous from L p ' p+S to L q ' q ~ 5 for a certain 5 > 0, satisfying p + 5 < q — 5. 

The following lemma explains how strong assumptions on an extremizing sequence would 
imply its convergence to an extremizer. 

Lemma 3.1. Let X, Y be two measurable spaces and T be a bounded linear operator from 
L p (X) to L q (Y), with 1 < p < q < oo. Let us consider g n an extremizing sequence associated 
to the inequality ||T/|| 9 < A||/|| p . Let us assume the three following points: 

(a) f n converges weakly to a non-zero function f G L p (X), 

(b) f n converges almost everywhere to f, 

(c) T f n converges almost everywhere to Tf. 

Then we have the following conclusions: 

(i) f is an extremizer for the above inequality, 
(ii) Actually, f n converges strongly to f. 

This lemma is extremely general and its proof is rather simple; the reader can for instance 
consult [ ]. Originally, it was used to prove the existence of extremizers for the Hardy - 
Littlewood-Sobolev inequality. The three assumptions (a) , (b) , (c) are very strong. Indeed 
(a) can seem easy to be satisfied but when we have a non-compact group of symmetries, as in 
the inequality (3.1), an arbitrary extremizing sequence probably converges weakly to 0. Thus 
we can do nothing without a concentration-compactness lemma. (b) requires a certain structure 
about the extremizing sequence f n . (c) may be the easiest assumption to show -in particular 
for integral operator- using that f n converges weakly. Here we are looking at some radial non- 
increasing functions, which makes the study far easier. Indeed, we have the following theorem, 
which is sometimes called Helly's principle: 

Theorem 3.2. Let f n be a sequence of decreasing functions on an interval I C R, uniformly 
bounded. Then up to a passage to a subsequence, f n converges pointwise. 

This theorem has been known for a while. The idea is basically to extract convergent se- 
quences for all rational points, which leads to a pointwise limit which is decreasing, defined on 
the rational numbers. Then since the set of points of discontinuity for this limit is countable, we 
can extract once more and we get a pointwise limit everywhere. It then gives a very important 
compactness result for our purpose. 

Let us note dp = r d ~ x dr. From now, we will consider that T is a linear operator and a is a 
measure such that a ({0}) = 0, satisfying the assumptions below: 

(i) T maps LP (IR + , p) to L q (M + , a) with constant A and 1 < p < q < oo and T maps 
L p ' p+S (M+, p) to L q > q ~ s (R+, a) with constant B, for a 5 > such that p + 5 < q - 5; 

(ii) T satisfies the rearrangement inequality ||7"/|| ? < \\T (f*) \\ q , where /* is the nonin- 

creasing -radial- rearrangement of / with respect to p; 
(Hi) For any nonincreasing function /, Tf is also nonincreasing; 

(iv) The LP — > L q boundedness inequality is invariant under the action of dilations; 

which places us in the general frame of theorem 1.2. 
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The /c-plane transform does not satisfy these assumptions. But because of the rearrangement 
inequality (3.2), what we need to do is to look for extremizers for 1Z restricted to radial func- 
tions. On this subset of LP, 1Z is closely related to an operator acting on functions on M + . The 
geometric point of view make us introduce T the operator defined on continuous, compactly 
supported functions on IR + as 

77 (r) = J f (Vs 2 + r 2 ) s k ^ds. 

Then we have the following: 

Lemma 3.3. For all f radial, continuous, compactly supported function on M. d , and II G Q 
such that d (0, II) = r, 

(3.3) nf(U) = \S k - 1 \-Tf(r). 

Proof. Let us call P the /c-plane R k x {0} d ~ k . Let II e Q such that d (0, n) = r, and Q an 
isometry of R d such that 

fill = R k x {0} x ... x {0} x {r} = re d + P. 

Then we know that for a radial function /, 

Kf (II) = / / (x) dX n (x) = [ f (JT 1 *) t/A n (fi-'z) = t f (x) d\ P (x) . 
Jn Jnn Jp 

The measure on P is as simple as possible, this the Lebesgue measure on R fe . Thus using polar 
coordinates (s, 6) e IR + x we get 

Tlf(U)= / / (re d + s0) d6s k ~ l ds. 
J s =o Je^s k - 1 

Using that / is radial and that re^ and s# are orthogonal, we finally get 

Kf (n) = is*- 1 ! J f (Vs 2 + r 2 ) s^" 1 ^ = (S^ 1 ! ■ 77 (r) . 

□ 

The equation (3.3) shows that T is almost the fc-plane transform. T acts on some Lebesgue 
spaces, that we need to explicit, using this correspondence. Its domain is of course the space 
LP (]R + , r d_1 c/r) . On the other hand, we have 



\w\\\ 



/ \Kf(U) \ q da{n) = | J S ,fc - 1 |«|5 ,d - fc - 1 | / \Tf{r) \ q r d ~ k ' l dr, 

Jg Jr=0 



where the last line is obtained thanks to the formula (1.1) in [1]. This shows that T maps 
LP (R + , r d ~ l dr) to L q (M + , r d ~ k ~ 1 dr). Using what is written above about the fc-plane trans- 
form, and the same considerations, T satisfy all the assumptions of theorem 1.2. The corre- 
spondence formula (3.3) finally shows that the inequality ||7£/|| g < ||/|| p admits extremizers 
if and only if the inequality ||T/|| ? < ||/|| p does so. Thus part (i) of theorem 1.1 is indeed a 
particular case of theorem 1.2. At last, and this will be useful in the computation of the best 
constant, for all radial function /, 

\\Kf\\ Lq{ g 4(7) _ IS^HS^- 1 ^ ll^/llL*(R+,r««-*-i«*r) 



Lp I 



{S^Ip ll/llip(R+,r«l-idr) 



Now we have all the tools we need to prove the existence result. 

7 



Concentration-compactness result. As we already said, the main difficulty to be overcome 
is a compactness default for an arbitrary extremizing sequence. The first thing that we need is 
a way to concentrate some weight inside a bounded domain. The following lemma, which is a 
form of concentration-compactness principle, is the main idea for the existence theorem: 

Lemma 3.4. There exists a constant c depending only on p, q, d, 5 -that means, only on the 
parameters- such that the following is satisfied. Let f be nonincreasing, with \\f\\ p = 1 and 

117"/ 1| g > ^- There exists t such that if we call g : x to/ x j> t ^ ien 9 — ^b(o,c)> \\g\ 
and \\Tg\\ q = \\Tf\\ q . 

Proof. Let us choose f E LP nonincreasing, ||/|| p = 1 such that ||7"/|| g > 4. Then 
(3-5) ^<\\Tf\\ q <\\Tf\\ Lq ,-s<B\\f\\ LP , P+ s 
(3-6) < B\\f\\^\\f\\ft . 



I V 



In (3.5) we used the injection L q ' q 5 L q , and the boundedness of the operator T from L p ' p+5 
to L q ' q ~ s , with norm that we called B. (3.6) is a consequence of the interpolation inequality 
(2.2). It leads to: 

(3-7) \\fh^>C 

with C depending only on p, q, d, 5. We thus know that there exists a real number s = £g 1 > 

such that s df (s )p > C. Let us call g the function defined by g (x) = t f (t^x) . Then g 

remains nonincreasing; \\g\\ p = 1, ||7"<7|| g = ||7"/|| 9 ; and 

fi ({x, g (x) > 1}) = sin ({x, f (x) > s }) > C. 

Using now that g is nonincreasing, there exists c depending only on p, q, d, 5 such that g > 
1 b(o,c)- The other consequences follow from the dilation-invariance of the inequality. □ 

This lemma removes the difficulties generated by the non-compactness of the dilation group. 
Indeed if we consider an extremizing sequence of nonincreasing functions then it shows that 
modulo the dilation group there exists a subsequence that converges weakly to a non-zero 
function. The crucial point here was to use the boundedness in Lorentz space to concentrate 
most of the L p -norm of g inside a ball with controlled radius, centred at 0. 

Existence of extremizer. In this section, we will see how the previous lemma closes the exis- 
tence problem. 

Proof Let f n be an extremizing sequence for the inequality ||7"/|| g < A||/|| p ; we can as- 
sume that || T/n || 9 > 4- L et us call /* the nonincreasing rearrangement of f n . Now us- 
ing lemma 3.4 and inequality (3.2) we know that for each n there exists M n such that if 

g n (x) = M n f* {^MnX^ then g n is greater than 1 b(o,c)- Here c does not depend on n. Moreover, 
g n remains nonincreasing, and its L p -norm is still 1. 

Using that our inequality is dilation invariant -assumption (iv)- g n remains an extremizing 
sequence of nonincreasing functions. Then up to passage to a subsequence, g n converges dfx- 
almost everywhere. Indeed let us abuse notations and consider g n on (0, +oo). Let p > 0; 
if g n (p) was an unbounded sequence, then we would be able to extract a subsequence of g n , 
called <7$( n ), such that #$(„) (p) converges to infinity. Then using that g n is decreasing and p 
is positive we cannot have \\g n \\p — 1- That way g n is uniformly bounded on [p, +oo). By 
Helly's theorem g n converges on [p, oo), with an extraction. Doing that for a sequence pk > 



converging to we get that g n converges pointwise on M + , up to an extraction. Now using 
that [i ({0}) = 0, the sequence g n converges (i/i-almost everywhere. The extracted sequence 
will still be called g n . Let us call g the pointwise limit, which satisfies g > 1b(o,c)- Thus g is 
non-zero. 



g can also be regarded as the weak limit of g n in L p -since g n is bounded in L p for a value of 
p greater than 1, and since the limit of g n is unique in the distribution space D' . It proves that 
g lies in L p . So far we have proved points (a) and (b) in 3.1. Point (c) is the same as point (a): 
since g n is a sequence of nonincreasing functions Tg n is a sequence of nonincreasing functions. 
Moreover, if there existed a p > such that Tg n (p) were an unbounded sequence, then for the 
same reason as above the sequence HT^Hg would be unbounded, which is impossible. Then 
-up to an extraction- Tg n must converge everywhere, except maybe at 0. Using that Tis linear, 
continuous from L p to L q we know that T is continuous from L p with its weak topology to L q 
with its weak topology, and then the pointwise limit of Tg n is Tg. 

Finally, using the inequality p < g we can apply 3.1 and we get the part (i) of theorem 1.1. 

□ 

Application to the sharp Hardy-Little wood- Sobolev inequality. Here we will apply theo- 
rem 1.2 to the widely studied inequality: 



with p, A and q related through 



x\\^*f\\ q <A(\ lP ) 

1 A 1 

- + - = 1 + -; 

pa q 

1 < p < q < oo; 
< A < d. 

This is the Hardy-Littlewood-Sobolev inequality. It admits extremizers -see [4], [12]. Our 
theorem can be directly applied here. Indeed let T be the operator defined as 

T:f^g*f 

where g is the function defined as g (x) = \\x\\~ x , < A < d. It is important to note that g lies 
in the Lorentz space La >°°. Let us check the assumptions of the above theorem: 

(i) The operator T is continuous from L p (lR d ) to L q (lR d ) with 1 < p < q < oo satisfying 

1 A 1 

- + -7 = 1 + -- 

pa q 

T is more generally continuous from L p ' r to L q ' s for all s > r -see O'Neil, [15]. We 
can then choose 5 such that p<r = p + S<s = q — 5 < q. 
(ii) T satisfies the Riesz rearrangement inequality ||T(/*) \\ q > ||T/|| g , since g satisfies 
9* = 9- 

(Hi) For any nonnegative, nonincreasing, radial function /, Tf is also radial, nonincreasing 
-see [12] for instance. 

(iv) Using that the function g is homogeneous the inequality ||T/|| g < ^4.||/|| P is dilation- 
invariant. 

Thus we can apply the theorem that we just proved, restraining T to radial functions regarded 
as functions of the norm. It tells us that the Hardy-Littlewood-Sobolev inequality ||7"/|| 9 < 
A || /||p admits extremizers. This is a well known result but we believe that the way to prove it, 
especially the concentration-compactness lemma, is new. It is important to note that none of 
the assumptions above were hard to prove. 
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4. Best constant and value of extremizers for the &;-plane inequality 



So far we have proved a general existence theorem. Applied to the A; -plane transform in- 
equality (1.2), it leads to the existence of extremizers. We will give here the value of some 
extremizers and of the best constant, which solves the endpoint case of Baernstein and Loss 
conjecture in [1]. 

The existence of a large group of symmetries was clearly an obstacle to overcome to prove 
the existence of the extremizers. We will see in this section that this is no longer an obstacle 
for the research of the explicit values of extremizers, but rather an aid: we will even look for 
additional symmetries. 

We start this section by a small lemma that is needed to get the explicit value of extremizers: 

Lemma 4.1. Iff is an extremizer for (1.2) then f does not change its sign. 

Proof. If / is an extremizer, then using A = \\lZf\\ q < ||72 (|/|) || g < A we deduce that 
1 72./ 1 = 1Z (| /|) almost everywhere on Q. Then we can assume that IZf > -almost everywhere 
on Q. Let us call E = {x, f (x) > 0}. Then using that ft E > f, H(fl E ) > Kf and 
II f^-E ||p < ll/llpj f^E must be an extremizer. Using that / is an extremizer too, ||/l £ || p = 
andso|£ c | = 0. □ 



Thus we can consider extremizers that are nonnegative. Here we want to prove the following: 
Theorem 4.2. An extremizer for the inequality (1.2) is given by 



(4.1) f(x) 



1 



1 + \\x\ 



2 



As a matter of fact, since any invertible affine map is a symmetry of the inequality (1.2), this 
theorem is equivalent to part (ii) of theorem 1.1. 



Let us explain the process of the proof before the details. Our purpose here is to introduce 
two operators V, S acting on L p , formally satisfying: V and S preserve the L p -norm of suitable 
functions, and 

(4.2) \\Kf\\ q < \\nsf\\ q , \\Kf\\ q < \\KVf\\ q . 

This means that V and S globally increase the functional / ^jjp • Now using additional 
properties of S and V, we will apply a theorem from Carlen and Loss stated in [4] to show that 
for any choice of / 6 L p , the sequence (VS) n f converges to an explicit function h. Starting 
from a function / which is an extremizer, and using (4.2), h must be an extremizer and is ex- 
plicitly known. 



In practice, the operator V will be the symmetric rearrangement />->■/*, and S will be a 
symmetry of the inequality. The class of functions whose norm is preserved under the action 
of V and S will be the nonnegative functions. The operator S is special in a certain sense: it 
does not preserve the class of radial functions. Thus if we were able to construct an extremizer 
such that Sh = h and Vh = h, then the explicit value of h could be determined. A way to 
construct such an extremizer is described in the next section. But we can already note that an 
extremizer satisfying this condition must satisfies (VS) n h = h for all n; this way, considering 
the sequence (VS) n f where / is already an extremizer is probably a good idea. 
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Competing operators. As we said we are following the approach introduced by Carlen and 
Loss in [4]. We might as well refer to the book [3]. In a first time we sum up the general results 
stated in this book, chapter II, paragraph 3.4: let B be a Banach space of real valued functions, 
with norm || • ||. Let us consider B + the cone of nonnegative functions; let us assume that B + 
is closed. Let us introduce some definitions: 

Definition 4.3. An operator Aon B is called properly contractive provided that 

(i) A is norm preserving on B + , i.e., \\Af\\ = \\f\\ for all f G B + , 
(ii) A is contractive on B + , i.e., for all f, g G B + , \\Af — Ag\\ < \\f — g\\, 

(iii) A is order preserving on B + , i.e., for all f, g G B + , f < g => Af < Ag, 

(iv) A is homogeneous of degree one on B + , i.e., for all f G B + , A > 0, A (A/) = XAf. 

Note that we do not need A to be linear. Some examples of such operators are for instance 
the radial nonincreasing rearrangement / i— > f* or any linear isometry on B. 

Definition 4.4. Given a pair of properly contractive operators S and V, it is said that S com- 
petes with V if for f G B + , 

feR(V)nSR(V)^Sf = f. 

Here R denotes the range. 

Theorem 4.5. Suppose that S and V are both properly contractive, that V 2 = V and that S 
competes with V. Suppose further that there is a dense set B C B + and sets K N satisfying 
L>nK n = B and for all integer N, SK N C K N , VK N C K N , and VK N relatively compact in 
B. Finally suppose that there exists a function h G B + with Sh = Vh = h and such that for 
all f G B+, 

(4.3) \\Vf 
Then for any f G B + , 

exists. Moreover, ST = T and VT 

An additional symmetry. Now we come back to the work of Christ. Using correspondence 
between a convolution operator that he studied in the three papers [6], [7], [8] he proved in [9] 
the existence of an additional symmetry for the Radon transform inequality, which is the case 
k — d — 1. It is defined as: 

U(v) = ^/ (-,-)■ 

\s\ d \s sj 

It satisfies then \\If \\ j+i = ||/||d+i and \\Tl d -iIf\\ d+1 = \\7td-if\\d+i' Fortunately it happens 

d d 

that this symmetry, slightly modified, is working for the LP — > L q inequality related to the 
fc-plane transform. 

Lemma 4.6. Let S be the operator defined as 

where (u, s) G IR'' -1 x (R — {0}). Then S is an isometry of LP and satisfies the identity: 

(4.4) \\nsf\\ q = \\nfU 

for any nonnegative function f. 

n 



-h\\ = \\f-h\\=>Vf = f. 

Tf= lim (VS) n f 
= T. 



$ (x) 



Proof. Let us check first that S is an isometry of LP. Let us call 

V 1 

X^ Xd t 

for x = (x', Xd) G x (R — {0}). Then its Jacobian determinant is 

1 



J$ x 



\d+l 



\ x d\ 

which shows that ||«S/|| P = Then we just have to prove the equality (4.4). The proof is 

nothing more than calculation. Let us introduce a bunch of notations before we begin: 

n(x , ...,x k ) 

denotes the unique A; -plane containing the linearly independent points x , x k G M d x ... x IR d ; 
Let us define TZf as 

TZf (x , x k ) = / / (x + Ai (zi - x Q ) + ... + X k (x k - x Q )) d\i...d\ k . 

Thus we have the correspondence 

(4.5) V (x , x k ) ■ TZf (x Q , x k ) = TZf (II (x Q , x k )) 

where V (xq, x k ) is the volume of the ^-simplex (xo, x k ). We want in a first time to prove 
the following pointwise estimate: 

Lemma 4.7. For all f G C£°,for all xq, x k G ~R d x ... x R d , linearly independent and such 
that $ (xq) (x k ) exist and are linearly independent, 



(uSfj (x , ...,x k ) 



Kf)(<j>(x ),...,$(xk)) 



\X0d • •■• • Xkd\ 

Proof. There might be a simpler proof but we can only offer some calculus to state this iden- 
tity. Let us call a = [x + Ai (xi — x ) + ... + X k (x k — x )] d -which implicitly depends on 
Ai, X k - and A = (Ai, X k ) G R k . Thus 
(4.6) 

ns f ) (x , ...,x k ) = J j^f ( 4 + AlK " x ° ) + ;- + AfcK " x ° ) + ed ) dX. 

Let us make the change of variable 

(4.7) A; = a _1 Ai; ...; X'^ = a^Xk-i] X' k = aT 1 . 

Then 

dx' = l[x "~ x J dl dx 



and (4.6) becomes 

(nsf^j (x , ...,x fc ) 



/ f [ Vk + X' k (x' + e d - x od y k ) + A • (x' { - x' - [x t - x ] d y k ) 



dX' 



[x k - x ] d 



X i Xq 



where 

" [x,-x„]/ 

This formula is somehow important: it shows that we are still integrating / over a &-plane. 
Which one? When we were computing TZSf (xo, x k ), we were interested only by the values 
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of / on $ (II (x , x k )). That way it is simple to guess that TZSf (x , x k ) is closely related 
to IT ($ (xq) (x k )). And indeed, we just have to check that any of the points Xj can be 

written 

k-l 

(4.8) xj = y k + X' k (x' + e d - y k ) + K ( x i ~ x 'o- \ x i ~ x o)d Vk) 

for suitable choice of A'. Taking A = and A' given by (4.7) for this choice of A, we get the 
equality (4.8). Let us now make the other change of variables: 

V — \' - Afc-1 \/ _ A *> 

A l — 7 T - ' ■••) A fc-1 — 7 T - ' A k — • 

[Xi — Xq\, [Xk-l — Xq\ h X d 



We finally get: 

(nsf^j (x , ...,x k ) 



\ f f v'k + h (9 (x ) -y' k ) + J2 ^ (y'i - y' k ) ) , , ^ f x 

J* k V t=i / \ x od\[U=i I [ x i~ x o\ d \ 

Let us come back to the correspondence between 1Z and 71, (4.5). Since we want to find a 
relation between [TZSf) (x , ...,x k ) and [TZf) ($ (x ) {x k )), the above algebra tells us 



that it is equivalent to find a relation between the two following volumes: 

V ($ (x ) , ...,y k );V ($ (x ) , $ (xi) (a*)) . 

Lemma 4.8. 1/ (<E> (x ) , j/i, and 1/ (<E> (x ) , $ (xi) (x*;)) are related through 



V($(x ),$(x 1 ),...,$(x k )) = -|-r 
Proof. This is an easy calculation. With a direct calculus, 



A; 

X d 



i=l 



1 

■Lid 



X id r-r / \ t / \i XQdX; ~\- XQdCd Xj^Xn %id&d 

[$ (Xi) - $ (x )j - 



[Xj - x ] d x d [x, - x ] d 

and on the other hand, 

^ , \ x dX^ + xo^ed — x^Xq — x^e^ 
- $ (x ) = ; = . 

Xod [Xj — X()\ d 

It proves the equality 

$ ( Xi ) - $ (x ) =(l-^) [ Vi - $ (x )] . 

V x idJ 

Thus using that 

V ($ (x ) , $ (xO (x fc )) = V (0, $ (x x ) - $ (x ) (x fe ) - $ (x )) 

the lemma 4.8 is proved. □ 

Let us come back to the proof of lemma 4.7. Using the correspondence described in (4.5) 
and the previous lemma we finally get the equality 



fes/J (x , ...,x fc ) = - 



Kf) ($(x ),...,$(x fc )) 

\ x 0d • •■• • Xkd\ 

□ 
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At last, let us come back to the proof of lemma 4.6. Since the set of bad points x , x fc -we 
mean points which do not satisfy the natural assumptions of 4.7- has null Lebesgue measure in 

we do not consider them. Let us use Drury's formula, proved in [10]: 
(4.9) \\Hf\\l = [ dx ...dx k f (x ) -...•/ (x fc ) ■ tif (x , x k ) d ~ k . 

J(R d ) 

Now everything that remains to be done is an easy change of variable Z{ = $ (xj). Indeed, 

\\nsf\\* = [ dx ...dx k -^— T f ($ (x )) • ... • y^-J ($ (x fc )) • (nsf (x 0) x k )Y~ k 

J(M.A \ x 0d\ \ x kd\ ^ ' 

dx ...dx k - — \-—f ($ (x )) ■ ... ■ - — —rf ($ (x fc )) • (^/ ($ (x ) , $ (a;*)) 
dz ...dz k f (z ) •...•/ (« fc ) • ^/ («b, ^fc) d ^ fc 

) 

= IWII*. 

□ 

Since we introduced a lot of material, it is convenient to prove only now what we have 
claimed all along the paper: 

Lemma 4.9. Let f lie in LP and L be an invertible affine map, then 

\\n(foL)\\ q jjg/jjg 

\\f°L\\ P \\f\\ P ' 

Proof. The proof is a direct consequence of the correspondence formula (4.5) and of Drury's 
formula (4.9). Indeed, let L be an invertible affine map then 

It (/ o L) (x , x k ) = TLf (Lx , Lx k ) 
and then by the change of variable Zi = Lxi in Drury's formula we get 

\\1Z(foL) || 9 = |det(L)|-F||^/|| g , 
which ends the proof. □ 

Our goal is now to apply theorem 4.5. We have two operators acting on LP which are in- 
creasing the L 9 -norm of the A; -plane transform, and preserving the norm of nonnegative, L p - 
functions. Let us call V the rearrangement operator / !->■ /*, we get the following proposition 
which is almost the end of the proof: 

Proposition 4.10. The operators V and S satisfy the assumptions of theorem 4.5, with the 
Banach space LP. 

Proof. S and V are both properly contractive operators. Let us check that S competes with 
V: this is an easy consequence of the below lemma, 4.11. We now have to check that S and 
V satisfy the assumptions of 4.5. We follow the arguments of Carlen and Loss in [3]. Let us 
define 



d-k 



h (x) 

Then Sh = h, Vh = h, and so with 



1 



1 + lid 



K N = {fEL p ,0<f<Nh} 
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it is straightforward to check that VK N C K N , SK N C K N . Moreover VK N is a compact 
subset of LP, Indeed, let us consider a sequence /„ £ VK N . Then f n is radial, nonincreasing, 
and since h lies in L°°, the sequence f n is bounded in L°°. Thus because of Helly's principle f n 
admits a subsequence that is converging almost everywhere. But since < f n < Nh, because 
of the dominated convergence theorem this subsequence also converges in LP, which implies 
that VK N is relatively compact. Moreover, LP = VJ N K N is a dense subset of nonnegative 
elements of LP -since nonnegative, continuous, compactly supported functions are dense in Lp. 



The hardest part is to prove the assumption (4.3). Fortunately, since h is strictly nonincreas- 
ing, it has already been done in [4]. □ 



Lemma 4.11. Let h £ L p such that Vh = Sh = h. Then there exists a constant C such that 

1 



h(x) = C 



x 



k+l 
2 



Proof. Let us choose h such that Sh = Vh = h, then h is equal to its own rearrangement and 
so is defined on -at least- M. d — {0}. Moreover, Sh must be radial. This leads to 



Sh (u, Vl + u 2 



2 



h 



a 



1 + u 1 



k + l 
2 



h (e d ) 



using that h is radial. But since h = Sh is also radial, 

Sh (u, Vl + u 2 ) = Sh (0, Vl + 2m 2 ) = h (0, Vl + 2u 2 ) 
we get the equality 

2 



(4.10) 



/i(aO = MO,||ar||) 



2 



1+ lid 



h(e d ) 



for all x £ M d such that ||x|| > 1. For < 1 the equality Sh = h shows that (4.10) is also 
right, which proves the lemma. □ 

Proof of the theorem. Now we have all the material that we need to prove 4.2. Let f > be 
an extremizer for (1.2), whose existence has already been proved. Let us define the limit 

h = Tf = lim (VS) n f . 

n— >oo 

Then because of the inequality (3.2) and the equality (4.4), h is still an extremizer. Moreover, 
because of theorem 4.5, Vh = Sh = h and then h satisfies the assumptions of lemma 4.1 1. We 
then get: 

2 



h(x) = h (e d ) 



1+ x 



k+l 
2 



Value of the best constant. Here we describe the way to compute the value of the best con- 
stant. We use the correspondence (3.3) described in the previous section, and the formula (3.4), 
and only think about T and its related measurable spaces instead of 1Z. Let h be the radial 
extremizer 

1 



h(r) 



k+l 
2 



_l + r 2 _ 

A family of integrals will be useful to compute its L p -norm and the L 9 -norm of Th. These 
integrals are defined as 

poo j.m 

I (m, n) = -dt. 

Jo (l+t 2 p 
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The change of variable t = tan (9) states a relation between / (n, m) and the function f3: 



I(m,n) = -p 
We recall that the function j3 is defined as 



m + 1 n — m — 1 



P(x,y) = ^ I sin (6*) 2 "" 1 cos (6») zy ~ i d0. 



Then: 



00 r d ~ x dr 1 
_ = /(d_l,d+l) = -/3 

o fl + r 2 )~ 2 



d 1 



2' 2 ' 



Th (r) 



oo „,fc— 1 



u du 



,I(k-l,k + l) 



using the change of variable s 2 = (1 + r 2 ) it 2 ; 



lir/iii^/CA-Lfc+i] 



- I(k-l,k+l) Q I(d-k-l,d+l). 

o (1 + r 2 ) 2 



Now let us recall the fundamental relations: 

f3 (x,y) 

1 



\S 



n—l I 



r (x + y) ' 

7T2 



They lead to the formula 

\Kh\\ a 



A(k,d) 



\h\ 



7;-2(d+l) . y 



d + 1 \ d+1 



■ r 



fc + i 



d 
d+1 



k-d 



\s k 



\s d \ k . 



1 

d+1 



For instance, in the cases of the X-ray and the Radon transform transform in the 3-dimensional 
space, 

A (1, 3) =tt3 ~ 1,33 
A (2, 3) = vr~i ~ 0,651. 

An alternative proof that does not use the existence theorem. Let us consider an extrem- 
izing sequence for (1.2), called f m . Then |/ m | is still an extremizing sequence and so we can 
assume that f m is nonnegative. Then for each integer m, the sequence (SV) n f m converges to 
a function h m whose value is given by 4.1 1, 



h m (%) — C n 



1 + x 



2 



Moreover, since f m is normalized, it is the same for h m which forces the constant C m to be 
independent of m, and then h m to be independent of m. At last, 



.4 



\Wm\\ q < \\Kh\\ q 



which proves that h is an extremizer, without the existence part of theorem 1.1. 
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5. The question of the uniqueness 



We shall discuss here the question of the uniqueness of extremizers of (3.1). We will assume 
d > 3. This is not annoying: indeed, for the case d = 2, the only A; -plane transform is the 
Radon transform and has been thoroughly studied by Christ in [9]. 

The uniqueness problem for the Radon transform has been solved by Christ in his paper [9]. 
The main tool for the proof is the following: 

Theorem 5.1. Let k = d — 1, and f be a nonnegative extremizer. Then there exist a radial, 
nonincreasing, nonnegative extremizer F, and an invertible affine map L, such that f = F o L. 

Then it followed that all the work was almost done. Christ characterized all the extremizers, 
using the uniqueness theorem 5.1 two times, in a certain sense. His approach is very interesting 
because the question of the uniqueness is curiously intertwined with the question of the exis- 
tence. Here we want to develop a different approach, for an arbitrary < k < d — 1, assuming 
that a result similar to theorem 5.1 is true. This is for instance the case of the Radon transform 
-see above- and the X-Ray transform -proved by Taryn Flock, to appear. More accurately, we 
want to prove the following: 

Theorem 5.2. Let 1 < k < d — 1. Assume that any extremizer for the k-plane transform 
inequality (1.2) can be written f o L with f a radial, nonincreasing extremizer and L an affine 
map. Then any extremizer can be written 



with C > and L an invertible affine map. 

This is not as simple as we could guess. Indeed, it shows that we can deduce global unique- 
ness from the single uniqueness modulo radial extremizers. Of course one of the main tool here 
will be the use of the symmetry S combined with the fact that an extremizer is a radial function 
composed with an affine map. Thus we will use again the competing symmetry theory. From 
now we will assume that k is such that any extremizer for (1.2) can be written / o L with / 
radial and L an affine map. Our main lemma is the following: 

Lemma 5.3. Let f be a radial nonincreasing extremizer. Then (VS) 2 acts on f as a dilatation. 

Let us choose / a radial nonincreasing extremizer. Then / is not the -almost everywhere- 
null function. Thus there exists Ao > such that / (Aoe^) ^ 0. As we will explain later, there 
is no harm assuming Ao = 1, using that the dilations group is a symmetry group. 

Sf is also an extremizer. It follows that there exist F : R + — > R, nonincreasing, a linear 
invertible map L and a vector x e R d such that 



C 



k+l 
2 



(5.1) 



1 + \\Lx\\ 2 



(5.2) 



Sf (x) = F(\\x + Lx\\). 



Computing Sf (u, \At 2 + l), we get 



1 



2 




(5.3) 



for all u e R^ 1 x {0}. Let C = f (e d ) ^ 0. 



Lemma 5.4. The map F is decreasing, as a function of the norm. 
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Proof. Let us assume that there exists < a < (3 such that F is constant on [a, (3). If F (a) = 
then since F is nonnegative, nonincreasing, F = on [a, oo). Thus, because of (5.3), for all 
u g M d_1 x {0}, 

1 1 Lit + vl-|- u 2 Led + xq\\ < a. 

This is not possible: indeed, let us write Lz = xq, then since L _1 is Lipschitz, there exists a 
constant c > such that for all u G x {0} 

(5.4) c 2 \\u + VTTu 2 e d + z \\ 2 < a 2 . 
Let us develop the right member: 

(5.5) \\u + Vl + u 2 e d + z \\ 2 = 1 + 2u 2 + 2(u, z ) + 2(Vl + u 2 e d ,z ) + 2(Vl + u 2 e d ,u). 

Now let us choose it = re!. Then (5.5) is equivalent to 2r 2 as r — >• oo. Thus (5.4) cannot hold 
and F (a) must be positive. 

Then it follows from (5.3) that whenever ||x + Lu + y/1 + u 2 Le d \\ G [a, 0\, \\u\\ must be 
constant, let us say equal to R: 

\\x + Lu + \/l + -R 2 Le d || G [a, /3] ^ ||w|| = i?. 

Let us call y = x + \/l + R 2 Le d and v = Lu + y . Then 

||v|| G [a,P] WL- 1 (v-y ) \\ = R. 

Let us call C C the ring of minimum radius a and maximum radius (3, and if the d — 1- 
plane L _1 (IR'' -1 x {0} — y )- The application 

* : C — > H 

v i — > L- 1 (v - y ) 

is Lipschitz, and so is its inverse. Thus 

H d - 1 (C)) > cH^ 1 (C) 

where 1-L d ~ l is the d— 1-Hausdorff measure and c > is a constant. But \I/ (C) is the intersection 
of the d — 1-plane H and the d — 1-sphere of radius R, which is of null 1-L d ~ l -measure, thus so 

is C: a = (3. □ 

The function F is then injective. That shows that \\xo+Lu+y/l + u 2 Le d \\ must be a function 
of it 2 only. The following lemma makes us conclude: 

Lemma 5.5. Let L an invertible linear map such that ||xo + Lu + VT-j- it 2 Led|| depends only 
on \\u ||. L/?e/7 L (R^ 1 x {0}) C span (Led) > and L| R d-i x r i preserves the norm, modulo a 
multiplicative constant. At last, there exists sq G M, d such that xq = soLe d . 

Proof. Let us choose u = 9 G S d ~ 2 x {0}. Then 

||x + Lu + Vl + u 2 Le d \\ 2 = \\L6\\ 2 + \\V2Le d + x \\ 2 + 2(L9, V2Le d + x ) 

is constant, and so does ||L0|| 2 + 2(L^, \/2Le d + x ). Let us call C its value. Then we have 
the polynomial equality 

||L^|| 2 + 2(L^,v / 2Le d + x ) = C 

which can hold for degree reasons only if ||L0|| is a constant and (L8, \f2Le d + xq) is a con- 
stant. Here we must assume d > 3, so the sphere S d ~ 2 contains an infinity of points. 
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The condition ||L0|| constant holds only if L| R d-i x { } preserves the norm, modulo a mul- 
tiplicative constant. Thus coming back to the assumption of the lemma, with u = r6 for all 
r > 0, the quantity 

(L9, Vl + r 2 Le d + x ) 



must depend only on r. Using 9 and —6, for all r, (L9, a/1 + r 2 Led + xq) = 0. But since L 
is invertible, the space spanned by L9 has dimension d — 1. Thus the space spanned by the 
vectors \/l + r 2 Led + xq for r > has dimension 1, which proves that there exists sq such that 

s Le d = Xq. □ 

Composing with an isometry we can assume that L (W 1 " 1 x {0}) C W 1 ^ 1 x {0}. Moreover 
\\Lu\\ depends only on ||u||, which implies that L restrained to R^ 1 x {0} must be a multiple 
of an isometry. We then deduce that there exist a, b, s such that \\L (u + se^) + x || 2 = a 2 u 2 + 
b 2 (s + so) 2 , for all (u, s) G IR d_1 x R. Thus we get the fundamental relation between / and F: 



Sf (u + se d ) = F \^Ja 2 u 2 + b 2 (s + s ) 2 
In the case X ^ 1, let us call g the function 

Then g satisfies g (e^) ^ and there exist L, x satisfying (5.2). It follows from the above 
study that there exist a, b, s three real numbers such that for all u £ R d_1 x {0}, s £ R, 



Sg (u + se d ) = F a 2 u 2 + b 2 (s + s ) 2 

But Sf and Sg are linked through 

Sg(u,s) = X k +1 Sf(u,X s). 
Thus changing b to X b and s to j^, we have the same conclusion. 

Now changing F to G = F (y/ab-\ , G remains nonincreasing and we get 



Sf (u + se d ) = F ^a 2 u 2 + b 2 (s + s ) 2 j = G i^j^u 2 + ^(s + s ) 2 

reducing the number of unknown parameters in our system. The following lemma sums up the 
situation: 

Lemma 5.6. Let f be a radial nonincreasing extremizer for (1.2). Then there exist a nonin- 
creasing, function G, s £ R and c a positive number, such that for all u + se d £ R d , 



Sf (u + se d ) = G I \lcu 2 + - (s + s ) 2 



c 



Thus we accomplished our first step in our identification program: we know how the operator 
S acts on radial extremizers. Now we have to understand how V acts on functions g whose 
form is 



g : u + se d t-S- G \ ^ cu 2 + ^(s + s ) 2 
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This is way easier. First, we can assume that s = 0: indeed, g (• — s e d )* = g*. Moreover, 
G is decreasing and so the level sets of g are ellipsoids cu 2 + c~ l s 2 < R 2 . The corresponding 
rearranged sets are balls of radius R', with R' satisfying the relation 

R' d = —c-R 



d-2 

C 2 C 2 



Thus 



Vg (se d ) = G (c^s) = 1 k+1 f 



coming back to the relation defining G, and using that / is radial. And then 



d 



C d S 



C d S 



The right function even, and so is Vg. This forces s to be equal to 0. 

This characterizes the action of the operator VS on radial extremizers. Indeed, calling A 
c~ , we get the following lemma: 

Lemma 5.7. Let f be a radial nonincreasing extremizer. Then there exists A such that 



VSf{x) = X^\\ X \\^ f \X\\x 

Let us use again the competing symmetry theory: to construct an explicit extremizer of (3.1) 
we used iterations of VS, applied to any extremizer. Let us choose /o a radial extremizer. From 
now we will regard all the radial functions as functions of the norm instead of functions on M. d . 
Then VSf is still a radial extremizer and because of the previous lemma we know that there 
exists A such that 

^/M=(y fc+1 /(i 



Let us do that again: there exists A' such that 



(^V(r)=(^) <ysf)(± 

A fc+1 „A'r 



fc+i 



AV A \ X 



x k+i V a 

Since the operator VS preserves the norm, we must have XX' d = 1. With the parameter \x such 
that A' = jiX we get the following lemma: 

Lemma 5.8. Let f be a radial, nonincreasing extremizer for (1.2). Then there exists a real 
number \x > such that 

(VS) 2 f(r)=^f(»r). 

That proves that the operator VS acts on radial, nonincreasing extremizers as a dilatation. 
Now we are almost done. Indeed, let us consider f n = (V^iS) 2n /. For each n, there exists \x n 
such that 

(y5) 2n /M=^7M. 
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But the sequence f n converges in LP to the extremizer h described in theorem 4.2. Thus it 
converges weakly to a non-zero function, which is possible if and only if [i n converges to a 
non-zero value. That ends the proof of 5.2: every nonnegative radial extremizer can be written 

_, k+l 
1 1~ 



with a, b > 0. 
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